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Method and Apparatus for Electronic Delivery of Electronic 

Model Images 

Technical Field 

The invention relates generally to a distributed computing system for the creation and 
5 distribution of electronic models of objects and more particularly to a system, method and 
article of manufacture for delivering and manipulating electronic model images to end users 
using a distributed computing system. 

Background 

Computational resources available for use by various end users of computing systems 
10 has increased significantly. This increase in capability of systems has created the ability for 
many more end users to utilize computer based image systems to replace processes that 
utilize paper and physical model processes. In the past, computer aided design, drafting, and 
manufacture (CAD/CAM) tools represented an area of applications in which computer based 
image systems have migrated from paper and model based processes to electronic systems. 

1 5 These CAD/CAM system typically consist of design and drafting tools that allow 

technical designers to build systems that were previously designed on paper using draftsmen. 
Over time, the computing system and their respective tools have allowed increasing 
interactive manipulation of components during the design process. This advance in design of 
items that are then manufactured has occurred using these computer aided systems. 
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These CAD/CAM systems, however, typically start their processes with a set of 
pre-defined libraries of components that may be used by the user of the computing system. 
For example, electronic schematics possess a library of components that are used to specify a 
circuit and its layout. The creation of these libraries, as well as the amount of computational 
resources needed to perform the operations related to these systems, has prevented the wide- 
spread use of these systems in other areas of technology. 

With the advances recently made computational systems, these computer based image 
systems may be used to permit end users to replace paper and physical models with 
electronic images. Two areas of technology present additional obstacles to the more 
widespread use of these systems. First, a mechanism to capture image representations of 
physical objects accurately and with sufficient resolution is needed in a form that is both 
inexpensive to operate while providing rapid turn-around for users. Second, a mechanism to 
easily transmit the images to end users from the location where the image representation of 
physical objects are generated is also needed. Neither of these latter obstacles has been 
overcome in existing imaging systems. 

Summary 

The present invention relates to a method, apparatus, and article of manufacture for 
delivering and manipulating electronic model images to end users using a distributed 
computing system. 
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A system in accordance with the principles of the present invention includes a 
distributed computing system delivering and manipulating electronic model images to end 
users. One aspect of the present invention includes a method for providing electronic 
delivery of electronic model images. The method generates one or more electronic model 
5 images, a portion of the electronic model images being generated from scanned electronic data 
of a physical object, stores the electronic model images within computer readable memory of 
a server-based computing system, delivers the electronic model images to a remote client 
computer over a distributed communications network, manipulates the electronic model 
images upon the remote client computer, and performs analysis and a course of action using 
10 the manipulated electronic model images. The electronic model images comprise in part a 
polygonal mesh representation of the physical object. 

Other embodiments of a system in accordance with the principles of the invention 
may include alternative or optional additional aspects. One such aspect of the present 
invention is a method and computer data product encoding instructions for providing 

1 5 electronic model image data files to a remote client computer using a server-based computing 
system over a distributed communications network. The method receives an electronic model 
image data files by the server-based computing system, stores the electronic model image data 
files within non- volatile computer readable memory within the server-based computing 
system, receives a search query from the remote client computer to identify one or more 

20 electronic model image data files, receives a file transfer request from the remote client 

computer requesting one or more electronic model image data files, and transmits one or more 
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electronic model image data files to the remote client computer. The electronic model image 
data files have a file header info data block containing data used to identify a physical object 
represented by the electronic model image data file and an electronic model image, a portion of 
the electronic model image containing a polygonal mesh representation of the physical object 
5 generated from scanned electronic data of a physical object. 

Yet another aspect of the present invention is a server based computing system for 
providing electronic model image data files to a remote client computer over a distributed 
communications network. The computing system has a communications connection to the 
distributed communications network, a communications server module for receiving remotely 

1 0 generated electronic model image data files, receiving search query requests from the remote 
client computer, and transmitting a requested electronic model image data file to the remote 
client computer in response to a file transfer request, a relational database module for 
maintaining a electronic model image description in a relational database corresponding to each 
received electronic model image data file for use in processing the search queries received from 

1 5 the remote client computer, and a file storage module for storing the electronic model image 
data files for use in processing file transfer requests received from the remote client computer. 

Another such aspect of the present invention is a method and computer data product 

encoding instructions for receiving electronic model image data files by a remote client 

computer from a server-based computing system over a distributed communications network. 

20 The method transmits a search query from the remote client computer to the server-based 

computing system to identify one or more electronic model image data files stored within the 
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server-based computing system, transmits a file transfer request from the remote client 
computer to the server-based computing system requesting one or more electronic model 
image data files, receives one or more electronic model image data files, manipulates the 
electronic model images upon the remote client computer, and performs analysis and a course 
5 of action using the manipulated electronic model images. 

These and various other advantages and features of novelty which characterize the 
invention are pointed out with particularity in the claims annexed hereto and form a part 
hereof. However, for a better understanding of the invention, its advantages, and the objects 
obtained by its use, reference should be made to the drawings which form a further part 
1 0 hereof, and to accompanying descriptive matter, in which there are illustrated and described 
specific examples of an apparatus in accordance with the invention. 

Brief Description of the Drawings 

Fig. 1 illustrates a distributed computing system for the creation and distribution of 
electronic models of objects according to one embodiment of the present invention. 

1 5 Fig. 2 illustrates an exemplary computing system useful for implementing an 

embodiment of the present invention. 

Fig. 3 illustrates an eModel generation system according to an embodiment of the 
present invention. 

Fig. 4 illustrates an eModel for an impression of a patient's mouth and teeth according 
20 to yet another example embodiment of the present invention. 
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Fig. 5 illustrates an eModel for a shell from a cellular telephone case according to yet 
another example embodiment of the present invention. 

Fig. 6 illustrates a block diagram for an eModel generation and distribution system 
according to an embodiment of the present invention. 

Fig. 7 illustrates a block diagram for an eModel generation process according to yet 
another example embodiment of the present invention. 

Figs. 8a-b illustrate an example of an object from which an eModel is generated 
according to yet another example embodiment of the present invention. 

Fig. 9 illustrates a representation of the object in Fig. 8 using a polygonal mesh 
according to an embodiment of the present invention. 

Fig. 10 illustrates a simplified representation of the object in Fig. 8 using a reduced 
polygonal mesh according to yet another example embodiment of the present invention. 

Fig. 1 1 illustrates a format for an eModel data file according to yet another example 
embodiment of the present invention. 

Fig. 12 illustrates an eModel data server system an embodiment of the present 
invention. 

Fig. 13 illustrates another eModel data server system according to yet another 
example embodiment of the present invention. 

Fig, 14 illustrates an eModel for an impression of a patient's mouth according to yet 
another example embodiment of the present invention. 

Figs. 15a-b illustrate use of an eModel to determine spatial measurements 

corresponding to distances in a patient's mouth according to an embodiment of the present 
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invention. 

Figs. 16a-b illustrate manipulating positions of patient's teeth using an eModel 
according to yet another example embodiment of the present invention. 

Figs. 17a-c illustrate combining an eModel of a patient's teeth with an x-ray according 
to yet another example embodiment of the present invention. 

Fig. 18 illustrates processing modules used to implement an eModel data server 
according to an embodiment of the present invention. 

Fig. 1 9 illustrates an operational flow for the processing performed within an eModel 
data server according to yet another example embodiment of the present invention. 

Fig. 20 illustrates processing modules used to implement an end user client computer 
according to yet another example embodiment of the present invention. 

Fig. 21 illustrates an operational flow for the processing performed within an end user 
client computer according to yet another example embodiment of the present invention. 

Detailed Description 

The present invention relates to a code generation method, apparatus, and article of 
manufacture for providing a distributed computing system for the creation and distribution of 
electronic models of objects. 

Fig. 1 illustrates a distributed computing system for the creation and distribution of 
electronic models of objects according to one embodiment of the present invention. End users 
operate a plurality of different computing systems 1 1 0-1 13 to perform their respective 
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computing tasks. End users typically use one general purpose computing system for a 
variety of tasks. In order for use of imaging systems to replace paper and model based 
systems, the imaging system used by end users 110-113 consist of laptop and desktop 
computing systems. 

5 These computing systems typically possess a mechanism to communicate with other 

computing systems over a communications network 101. The Internet 101, as a publicly 
available communications network, provides an available communications path between 
virtually any two computing systems after they first connect to the Internet. While other 
communications mechanisms exist and may be used, the Internet provides a well-known 
1 0 mechanism to communicate data between two computing systems. 

In an image-based eModel system, an end user 110 communicates over a 
communications network 101 to a server 121 to retrieve electronic eModels from a database 
122. The end user 122 may be located anywhere a connection to the communications 
network 101 exists to retrieve the eModels from the database 122. This database 122 may be 
15 located within an eModel data server system 102 that is maintained by third parties that 
provide maintenance, data back up, and similar data processing overhead functions that are 
not an overriding concern for an end user. This data back-up, for example, may consist of 
long-term archiving of data to replace maintenance of physical models that have in the past 
required a great deal of effort and expense to complete. 

20 The eModels themselves consist of a data file stored on the server 121 in a database 
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122 that allows quick and efficient access for users. These eModels are generated in a 
separate eModel generation system 103 that consists of one or more model scanning units 
131-134. These units 1 3 1 - 1 34 are connected together using a local communications network 
136 and a communications path 135 to the Internet 101. As such, eModels, once generated 
5 may be transferred to the eModel Data server system 102 for ultimate use by end users 110- 
113. 

With reference to Figure 2, an exemplary system for implementing the invention 
includes a general-purpose computing device in the form of a conventional personal computer 
200, including a processor unit 202, a system memory 204, and a system bus 206 that 

10 couples various system components including the system memory 204 to the processor unit 
200. The system bus 206 may be any of several types of bus structures including a memory 
bus or memory controller, a peripheral bus and a local bus using any of a variety of bus 
architectures. The system memory includes read only memory (ROM) 208 and random 
access memory (RAM) 210. A basic input/output system 212 (BIOS), which contains basic 

1 5 routines that help transfer information between elements within the personal computer 200, 
is stored in ROM 208. 

The personal computer 200 further includes a hard disk drive 212 for reading from and 

writing to a hard disk, a magnetic disk drive 214 for reading from or writing to a removable 

magnetic disk 216, and an optical disk drive 218 for reading from or writing to a removable 

20 optical disk 219 such as a CD ROM, DVD, or other optical media. The hard disk drive 212, 

magnetic disk drive 214, and optical disk drive 218 are connected to the system bus 206 by a 
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hard disk drive interface 220, a magnetic disk drive interface 222, and an optical drive 
interface 224, respectively. The drives and their associated computer-readable media provide 
nonvolatile storage of computer readable instructions, data structures, programs, and other 
data for the personal computer 200. 

Although the exemplary environment described herein employs a hard disk, a 
removable magnetic disk 216, and a removable optical disk 219, other types of computer- 
readable media capable of storing data can be used in the exemplary system. Examples of 
these other types of computer-readable mediums that can be used in the exemplary operating 
environment include magnetic cassettes, flash memory cards, digital video disks, Bernoulli 
cartridges, random access memories (RAMs), and read only memories (ROMs). 

A number of program modules may be stored on the hard disk, magnetic disk 216, 

optical disk 219, ROM 208 or RAM 210, including an operating system 226, one or more 

application programs 228, other program modules 230, and program data 232. A user may 

enter commands and information into the personal computer 200 through input devices such 

as a keyboard 234 and mouse 236 or other pointing device. Examples of other input devices 

may include a microphone, joystick, game pad, satellite dish, and scanner. These and other 

input devices are often connected to the processing unit 202 through a serial port interface 

240 that is coupled to the system bus 206. Nevertheless, these input devices also may be 

connected by other interfaces, such as a parallel port, game port, or a universal serial bus 

(USB). A monitor 242 or other type of display device is also connected to the system bus 

206 via an interface, such as a video adapter 244. In addition to the monitor 242, personal 
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computers typically include other peripheral output devices (not shown), such as speakers 
and printers. 

The personal computer 200 may operate in a networked environment using logical 
connections to one or more remote computers, such as a remote computer 246. The remote 
5 computer 246 may be another personal computer, a server, a router, a network PC, a peer 
device or other common network node, and typically includes many or all of the elements 
described above relative to the personal computer 200. The network connections include a 
local area network (LAN) 248 and a wide area network (WAN) 250. Such networking 
environments are commonplace in offices, enterprise-wide computer networks, intranets, and 
10 the Internet. 

When used in a LAN networking environment, the personal computer 200 is 
connected to the local network 248 through a network interface or adapter 252. When used in 
a WAN networking environment, the personal computer 200 typically includes a modem 254 
or other means for establishing communications over the wide area network 250, such as the 

15 Internet. The modem 254, which may be internal or external, is connected to the system bus 
206 via the serial port interface 240. In a networked environment, program modules depicted 
relative to the personal computer 200, or portions thereof, may be stored in the remote 
memory storage device. It will be appreciated that the network connections shown are 
exemplary, and other means of establishing a communications link between the computers 

20 may be used. 
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Additionally, the embodiments described herein are implemented as logical operations 
performed by a computer. The logical operations of these various embodiments of the 
present invention are implemented (1) as a sequence of computer implemented steps or 
program modules running on a computing system and/or (2) as interconnected machine 
5 modules or hardware logic within the computing system. The implementation is a matter of 
choice dependent on the performance requirements of the computing system implementing 
the invention. Accordingly, the logical operations making up the embodiments of the 
invention described herein can be variously referred to as operations, steps, or modules. 

Fig. 3 illustrates an eModel generation system according to an embodiment of the 
1 0 present invention. The eModel generation system 1 03 is an object scanning facility having 
one or more model scanner units 131-134 that scan user objects 300 using a laser scanner 310 
that mounts the user object 300 on a multi-axis scanning platform 311. The laser scanner 310 
interfaces with one or more programmable processing devices 321-322 to process the laser 
scanner data into usable object image data. These model scanner units 131-134 are connected 
1 5 together using a data communications network 1 36 to permit the image data to be transferred 
between processing devices. Ultimately, the eModel data is transferred to a data server 102 
over a communications network 101 like the Internet. 

In one embodiment, each model scanner unit 132 includes two processing devices 321- 

322 to process the laser scanner data and generate the model image data. In this embodiment, 

20 the processing utilizes one such computing device 321 to processing the scanner data to 

generate a polygonal mesh of triangles and utilizes a second computing system 322 to further 
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process the initial polygonal mesh into a reduced set of surfaces that may be ultimately used 
by an end user. One skilled in the art will recognize that these two computing devices may in 
fact be constructed using any number of programmable computing devices where the 
computing capacity of the devices used will determine the amount of time needed to complete 
5 a given processing task. As such, other embodiments of the present invention may be used 
for these computing devices without deviating from the spirit and scope of the present 
invention as recited within the attached claims. 

In a preferred embodiment, the laser scanner 3 10 is a line scanner of the type made by 
Laser Design, Incorporated of Bloomington MN, Model No. RPS-120. The scanner possess 

10 a capability to transfer data to a computing system 321 at a rate of 14,400 data points per 
second and have a resolution of 12 microns. In order to create adequate eModels for user 
items, the scanner 301 possesses a volumetric accuracy of approximately 25 microns. The 
multi-axis platform 311 rotates the user item 300 within the field of view of the laser scanner 
3 10 in order to collect sufficient data points from all orientations to observe the entire surface 

1 5 of the user obj ect 3 00. 

Fig. 4 illustrates an eModel for an impression of a patient's mouth and teeth according 

to yet another example embodiment of the present invention. In this example, an impression 

of a patient's mouth and teeth are obtained from a dental care provider. From the impression, 

a plaster model of the upper and lower teeth are obtained. These models have been typically 

20 used by dental care providers to observe and measure a patient's mouth and teeth when 

planning how a course of dental care treatment is to progress. According to the present 
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invention, the plaster model is scanned in the eModel generation system 102 to generate the 
upper 402 and lower 401 eModels that correspond to a digital image representation of the 
plaster model. 

Once the digital eModel is obtained, the plaster model is no longer needed. As such, 
5 the storage of the model is no longer required by dental care providers, as has been the case 
for most of the past practices of dental care providers. Because the eModel is a digital 
representation of the physical model, a plurality of user controls 41 1-412 are used by the end 
user to view the user item 300, in this case the patient's teeth 401-402, from any orientation. 
Measurements and other manipulations of the eModel are also permitted. 

1 0 Fig. 5 illustrates an eModel for a shell from a cellular telephone case according to yet 

another example embodiment of the present invention. In this second example, a shell from a 
cellular telephone 501 corresponds to the user item 300 that is scanned to generate an 
eModel. Any user item 300 that is small enough to fit within the scanning space of the 
scanner 310 and multi-axis platform 3 1 1 in the eModel generation system 1 03 may be used to 

1 5 generate an eModel. In the preferred embodiment, the user item is less that a 6-inch 

volumetric cube. One skilled in the art will recognize that other scanning devices that produce 
scanned image data at a sufficiently small resolution that permits larger items to be scanned 
may also be used without deviating from the spirit and scope of the present invention as 
recited within the attached claims. In addition, the nature and shape of the user item 300, 

20 whether it corresponds to a model of a patient's mouth and teeth or corresponds to a 

component of an item of manufacture, does not change the operation of the present invention 
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as recited within the attached claims. 

Fig. 6 illustrates a block diagram for an eModel generation and distribution system 
according to an embodiment of the present invention. The process starts 601 and an eModel 
is generated from a scan of an end user item in module 611. Once the eModel is generated, 
5 the model is stored within a data storage medium on a remotely accessible server in module 
612. Next, an end user receives an eModel of interest for use on his or her client computer 
over a communications network in module 613. 

Once an end user receives the eModel, the end user may view and manipulate the 
eModel as needed to complete any planning, analysis and similar operations in module 614. 
1 0 Test module 6 1 5 determines if a new eModel has been created as part of the end user 5 s 

manipulation of an eModel and if the newly created eModel should be saved for later use. If 
the new eModel exists and is to be saved, module 616 saves the eModel locally on the end 
user client computer for later use and the processing ends 602. If test module 615 determines 
that a new eModel is not to be saved, the processing also ends 602. 

1 5 Fig. 7 illustrates a block diagram for an eModel generation process according to yet 

another example embodiment of the present invention. The process for generating an eModel 
of a user item 300 starts when a scan module 701 utilizes a scanner 310 to generate a point 
cloud data file 711. For objects that typically fit within the 6 inch volumetric cube of the 
scanner, this point cloud data file 711 may comprises between 2 and 3 million data points. 

20 The large amount of data points generated from the scan of a single user item 300 has posed a 
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significant limitation upon the use of eModels in the past. In the preferred embodiment, the 
scanning process implemented in the scan module 701 is performed within the first of two 
programmable processors 321 within a given model scanner unit 132. 

The point cloud data file 71 1 represents a data point for each location on the surface 
of the user item 300. The file is processed into a polygonal mesh of triangles in a mesh 
module 702. In this process, the points from the point cloud data file are organized into 
triangles of neighboring points that describe the surface of the user item 300 that has been 
scanned. The creation of a polygonal mesh data file 712 that contains the specification of all 
of the triangles reduces the amount of data to between 1 00-300k triangles. 

The number of triangles that are used to describe a surface of the user item 300 may 
be reduced further in a filtering module 703 when a reduced polygonal mesh file 713 is 
created. This reduction of the number of triangles is accomplished when adjacent triangles are 
sufficiently co-planer to permit the surface described by two or more triangles to be similarly 
described using a single triangle. The reduced polygonal mesh data file 713 typically consists 
of 60k triangles that permits a manageable amount of data to be used when eModels are 
processed. 

The eModel are completed by an eModel transfer module 704 that attaches a file 
header that describes the user item in sufficient detail that it maybe retrieved at a later date. 
The eModel is contained within an eModel data file 714 that may be transmitted over the 
Internet 101 to the eModel data server for storage within its database. 
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Fig. 8a-b illustrate an example of an object from which a eModel is generated 
according to yet another example embodiment of the present invention. A simple geometric 
3D shape 801 is presented as an example of how a reduced polygonal mesh is generated that 
may be used as an eModel This shape 801 has two visible faces: a small triangular side face 
5 812 and a larger rectangular face 811. Three other faces make up this simple object that are 
not visible from the perspective shown in Fig. 8a. 

Fig, 8b shows this object 801 having a set of surface data points superimposed upon 
the object 801 faces. When a laser line scanner passes its sensor over a face of the object 801, 
a line of points corresponding to the position of the objects' surface are obtained. These 

10 points are separated by the spatial resolution of the scanner. The data points, P0 821 are 
specified using a 3 coordinate position X0, Y0, Z0. As the object 801 is moved within the 
scanning area of the multi-axis platform, the scanner translates the data points to a common 
coordinate system such that the collection of all points represents the points in a 3D 
coordinate system that corresponds to the surface of the item 801. These data points are 

1 5 contained within the point cloud data file 71 1 that is generated by the scan module 701 . 

Fig. 9 illustrates a representation of the object in Fig. 8 using a polygonal mesh 

according to an embodiment of the present invention. As discussed above, the point cloud 

data file 71 1 is reduced to a polygonal mesh of triangles in which the surface of the triangles 

are used to approximate the surface of the item 801. In this example, a triangle, Tl 900, is 

20 located on the larger surface 81 1 of the item 801 . The triangle Tl 900 is specified using the 

three corner points P0 901, PI 902, and P3 903. As before, each of these three points are 
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specified using a 3D coordinate system such that Tl 900 is defined: 
Tl: {P0,Pl,P2}or 

Tl: { [X0, Y0, Z0], [XI, Yl, Zl], { [X2, Y2, Z2] }. 

Each triangle in the polygonal mesh is specified using the three points as shown 
above. No particular order for the points making up the triangle is necessary. The smaller 
side 812 of the item 8 1 1 in this example is initially shown with six triangles 911-916. The 
triangles in the polygonal mesh may be created using any number of well known methods for 
reducing point position data into a polygonal mesh that approximates the surface of the 
object. 

Fig. 10 illustrates a simplified representation of the object in Fig. 8 using a reduced 
polygonal mesh according to yet another example embodiment of the present invention. A 
reduced polygonal mesh is generated by combining adjacent triangles in the original polygonal 
mesh when the two or more triangles are sufficiently coplanar that they may be represented 
using a single triangle. In this example, a large number of small triangles may have been 
originally generated mesh shown in Fig. 9. When a flat surface of the simple object 801 is 
considered, the number of triangles needed is reduced significantly 1001-1007. In the 
example, all of the small triangles from the small side 812 of the item 801 have been combined 
into a single triangle 101 L The processing associated with this filtering operation controls 
the amount of triangle combination by setting a threshold relating to the minimum amount of 
deviation from a single plane for the two or more triangles that is permitted before two or 
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more triangles are required to remain separate. This filtering process may be accomplished 
using a number of commercially available polygonal mesh processing products without 
deviating from the present invention as recited within the attached claims. 

Fig. 1 1 illustrates a format for an eModel data file according to yet another example 
5 embodiment of the present invention. The eModel data file consists of a file header info 

block 1 10 land a triangle specification block 1 102. The triangle specification block consists of 
the set of triangle definitions 1111-1113 that are used to define the reduced polygonal mesh. 
The file header info block 1101 includes a set of searchable identification information that 
may be used to identify a particular model from any number of related models. The mouth 
10 and teeth eModels, for example, will likely contain patient identification information such as 
name, date of birth, address, social security number that may be used to uniquely identify the 
patient from which the model was generated. The info block 101 1 may also contain dental 
care provider information such as the dentist name and address as well as the date on which 
the impression was taken that generated the eModel. 

1 5 For other items, such as the cellular phone shown in Fig. 5, any useful identifying 

information may be used. This data is typically ASCII encoded data that may be easily 
searched and processed as necessary. One skilled in the art will recognize how this file header 
info block 1101 may be modified to include any information needed by a particular 
application without deviating from the spirit and scope of the present invention as recited 

20 within the attached claims. 
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Fig. 12 illustrates an eModel data server system an embodiment of the present 
invention. The eModel data server 102 communicates with the eModel generation system 
103 and end users 1 10 over a communications network 101. The eModels that are generated 
are transmitted to the eModel data server 102 for storage in its databases 1204-1205 for later 
user. 

The eModel data server 102 includes a communications server module 1201, a 
database server module 1203, and an eModel storage server module 1202 to perform its tasks. 
The communications server module 1201 performs the communications functions needed to 
receive eModels from the generation system 103 as well as the communication functions 
needed to interact with end users when they wish to locate and download eModels of 
interest. 

The eModels received from the generation system 103 are stored within two 

databases. A copy of the file header info block 1 101 is stored within a first database 1204 

and the entire eModel file is stored within a file storage database 1205. This separation 

allows the file header info block data to be stored within a relational database to permit rapid 

searching for eModels of interest. Once the identity of a desired eModel is located in the 

relational database 1203, the end user may request a copy of the larger eModel file from the 

file storage database 1205. This separation of the two database functions allows the data 

storage and data processing requirements of each operation to be scaled independently of each 

other as the nature of the end user interaction with the server 103 is determined. If significant 

amounts of database query operations are occurring in a particular use of the server 103, the 
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processing capabilities of the relational database may be increased. If the server 103 is 
predominantly used to transfer large eModel files to users, data transfer capacity of the file 
storage database may be increased. 

Fig. 13 illustrates another eModel data server system according to yet another 
5 example embodiment of the present invention. In this particular embodiment, the 

communication server 1201, the eModel header database server 1203, and the eModel file 
storage server 1202 are all connected to a common local area network to perform the data 
communication operations. A firewall server 1312 connects the local area network to the 
Internet 101 for communications to end users 110 and the eModel generation system 102. 

10 The eModel file header info block database 1204 is connected to the eModel header 

database server 1203 to provide the relational database functions needed to located eModels 
of interest. The eModel database 1205 is connected to the eModel file storage server 1202 to 
provide the file storage for all of the eModels. 

Within the communications server 1201, a command and control module 1301 receives 
1 5 requests for operations and coordinates the processing of the other modules and servers to 
complete a processing and data retrieval request. A client interface module 1303 processes 
the entire communication request received from an end user 110. The eModel generation 
interface module 1301 processing all of the communication requests from the eModel 
generation system 102 to accept and store new eModels within the databases 1204-1205. 

20 In order to perform its processing functions, the communications server 1201 receives 
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the command messages listed in Table 1 . These commands allow eModels to be stored into 
the databases 1204-1205 and allow end users 1 10 to search for and retrieve eModels from the 
databases. 



Table 1 - Server Communication Commands 



Procedure 


Parameters 


Return 


Description 


user_get_emodelJist 


USER LOGIN NAME, 
USER PASSWORD, 
BEGIN_DATE, ENDJ3ATE 


E MODEL ID, 
PATIENT LAST NAME, 
PATIENT FIRST NAME, 
CREATIONJDATE 


get emodel 
META data 
between 
BEGIN_DATE 
and 

END DATE 


lab_get_userjist 


USERJ.ASTJMAME, 

i iorn r—i n o~r k i a a a i — 

USER FIRST NAME, 
USER ADDRESS CITY, 
USER ADDRESS STATE, 
USER_ORGANlZATION_NAME 


USERJ_OGINJ\IAME, 
USER TITLE, 
USER LAST NAME, 
USER FIRST NAME, 
USER MIDDLE NAME, 
USER ADDRESS CITY, 
USER ADDRESS STATE, 
USER ORGANIZATION NAME 


get a list of all 
data for 
specified user 


addjab 


LAB ORGANIZATION NAME, 
LAB LAST NAME, 
LAB FIRST NAME, 
LAB MIDDLE NAME, 
LAB TITLE, LAB PHONE, 
LAB FAX, LAB E MAIL, 
LAB ADDRESS STREET 1, 
LAB ADDRESS STREET 2, 
LAB_ADDRESS_STREET3, 
LAB ADDRESS CITY, 
LAB ADDRESS STATE, 
LAB ADDRESS COUNTRY, 
LAB ADDRESS ZIP, 
LAB LOGIN NAME, 
LAB PASSWORD 


none 


create a lab 
entry in the 
SQL 

database 


addjris_user 


USER ORGANIZATION NAME, 
USER LAST NAME, 
USER FIRST NAME, 
USER MIDDLE NAME, 
USER TITLE, USER PHONE, 
USER FAX, USER E MAIL, 
USER BULK MAIL, 
USER ADDRESS STREET 1, 
USER ADDRESS STREET 2, 
USER ADDRESS STREET 3, 
USER ADDRESS CITY, 
USER ADDRESS STATE, 
USER ADDRESS COUNTRY, 
USER ADDRESS ZIP, 
USER LOGIN NAME, 
USER PASSWORD 


none 


create a user 
account in 
the SQL 
database 
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Procedure 


Parameters 


Return 


Description 


add_scanner 


LAB ID, 

ELECTRICAL DRAWING, 
ELECTRICAL BOM, 
MECHANICAL DRAWING, 
MECHANICAL BOM 


none 


create a 
scanner entry 
in the SQL 
database 


add_scanner_serv_rec 


SCANNER ID, LAB ID, 
SCANNER_CALIBRATED, 
SCANNER MAINTENANCE, 
SCANNER REPAIRED, 
SCANNER GAGE SN, 
SCANNER GAGE N1ST, 
SCANNER LASER SN, 
SERVICE START DATE, 
SERVICE FINISH DATE, 
SERVICE DESCRIPTION, 
SERVICE TECHNICIAN 


none 


create a 
scanner 
service record 
entry in the 
SQL 

database 


add_emodel 


E MODEL ID, 
USER LOGIN NAME, 
SCANNER ID, 
USER DESCRIPTION, 
LAB DESCRIPTION, 
PAT1ENT_LAST_NAME, 
PATIENT FIRST NAME, 
PATIENT MIDDLE NAME, 
PATIENT TITLE, 
PATIENT BIRTHDATE, 
PATIENT ID, PATIENT SEX, 
PATIENT RACE, 
OPTION FIELD, 
F1LESERV NAME, 
CREATION DATE 


none 


create an 
emodel 
record in the 
SQL 

database 


get_all_user_jnfo 


USER LOGIN NAME, 
USER_PASSWORD 


USER ORGANIZATION NAME, 
USER LAST NAME, 
USER FIRST NAME, 
U SE R JVI 1 DDLEJMAM E, 
USER TITLE, USER PHONE, 
USER E MAIL, 
USER BULK MAIL, 
USER ADDRESS STREET 1, 
USER ADDRESS STREET 3, 
USER ADDRESS CITY, 
USER ADDRESS STATE, 
USER ADDRESS COUNTRY, 
USER ADDRESS ZIP 


retrieve a 
listing of all 
information 
for specified 
user 


get_alljabjnfo 


LAB LOGIN NAME, 
LAB_PASSWORD 


LAB ORGANIZATION NAME, 
LAB LAST NAME, 
LAB FIRST NAME, 
LAB_MIDDLE_NAME, 
LAB TITLE, LAB PHONE, 
LAB E MAIL, 
LAB BULK MAIL, 
LAB ADDRESS STREET 1, 
LAB ADDRESS STREET 3, 
LAB ADDRESS CITY, 
LAB ADDRESS STATE, 
LAB ADDRESS COUNTRY, 
LAB ADDRESS ZIP 


retrieve a 
listing of all 
information 
for specified 
lab 
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Procedure 

updatejjserjnfo 



updatejabjnfo 



auth_emodeLretv 



authjogin 



Parameters 

USERJD, 
USER_ORGANiZATION_NAME, 
USERJ-ASTJslAME, 
USER_FIRSTJMAME, 
USER_MIDDLE_NAME, 
USER_TITLE, USER„PHONE, 
USER_FAX, USER_E_MAIL ( 
USER_BULK_MAiL, 
USER_ADDRESS_STREET J , 
USER_ADDRESS_STREET_2, 
USER_ADDRESS_STREET_3, 
USER„ADDRESS_CITY, 
USER_ADDRESS_STATE, 
USER_ADDRESS„COUNTRY, 
USER__ADDRESS_ZIP, 
USER_LOGIN_NAME, 
OLD__PASSWORD, 
NEW PASSWORD 

LABJD, 
LAB_P RG AN IZAT I ON_N AM E, 
LAB_LAST_NAME, 
LAB _F 1 RST_N AM E , 
LABJ/liDDLE_NAME, 
LABJTTLE, LAB_PHONE, 
LAB_FAX, LAB_E_MA1L, 
LAB_ADDRESS_STREET_1 , 
i_AB_ADDRESS__STREET_2, 
LAB__ADDRESS_STREET_3, 
LAB__ADDRESS_CITY, 
LAB_ADDRESS_STATE, 
LAB_ADDRESS_COUNTRY, 
LAB_ADDRESS_ZIP, 
LAB_LOG I N_N AM E, 
OLD_PASSW0RD, 
NEW PASSWORD 
USER_LOGIN_NAME, 
USER_PASSWORD, 
E MODEL ID 



Retur n 

none 



none 



USERJ-OGINJMAME, 
USER PASSWORD 



E_MODELJD, FILESERVJP, 

FiLESERV_PORT 

or AUTHORIZATION DENIED 



description 

update 
nformation 
for specified 
user 



update 
information 
for specified 
lab 



PASSWORDJNCORRECT, or 

AUTHORIZED, or 
LOGIN_NAMEJNCORRECT 



determine 
whether user 
owns 
specified 
emodel 



determine 
whether user 
account 
exists, 
password 
correct 



Fig. 14 illustrates an eModel for an impression of a patient's mouth according to yet 
another example embodiment of the present invention. In this example, the upper portion of 
the eModel 402 has been electronically moved and placed in its position above the lower 
portion of the eModel 401. The plaster models typically used in the dental care industry 
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includes a base that allows easy spatial registration of the two portions of the eModel. This 
registration allows an end user to manipulate the parts of the eModel to observer and 
determine how the individual teeth interact as the two parts move together and apart from 
each other. The end user 1 1 0 may manipulate the eModel by moving, rotating and zooming 
5 to a perspective of interest. 

Figs. 15a-b illustrate use of an eModel to determine spatial measurements 
corresponding to distances in a patient's mouth according to an embodiment of the present 
invention. In Fig 15a, a zoomed view of a lower portion of the eModel 401 is shown in 
which individual spatial measurements of a tooth 1501 is determined by a user visually 

1 0 marking a first side of a tooth 1 502 using an input device such as a mouse and/or a trackball. 
Next the end user marks a second side 1503 of the tooth 1501 and the end user client system 
determines the distance between the two points as measured on the eModel polygonal mesh 
surface. This process may be repeated as many times as desired. In the past, the dental 
plaster model would be measured to obtain these values. The end user system may 

1 5 automatically calculate this information, more accurately without the need to maintain and 
use the physical models once a eModel has been scanned, generated and saved. 

Fig. 15b illustrates a similar set of spatial measurements being obtained for a series of 

teeth 1511 on the lower portion of the model 401 as well as a series of teeth 1 5 12 on the 

upper portion of the model 402. These measurements 151 1-1512 are typically used by 

20 dental care providers to determine a series of calculated values 1513 associated with the 

parabolic shape of a patient's mouth and teeth. The end user system may determine these 

Page 25 

GEODIGM Corporation 
Patent Application 



values automatically from the spatial data measured by an end user that in the past would 
have required a significant amount of effort to obtain the measurements 1511-1512 and then 
calculate the values 1513. 

Figs. 16a-b illustrate manipulating positions of patient's teeth using an eModel 
5 according to yet another example embodiment of the present invention. End users may be 
able to perform desired functions upon eModels that were difficult, or possibly impossible, 
to be performed upon physical models. Fig. 16a illustrates an upper portion of an eModel of 
a patient's teeth and mouth from a physical model obtained before dental treatment is 
performed. In this example, the dental care provider wishes to move the location of a number 
10 of teeth to better align them with the parabolic arc that human teeth are typically aligned. 

The dental care provide, as an end user of the system, selects and manipulates the location of 
three upper teeth 1601-1603 from a current position to a desired position. 

The end user interactively moves portions of the eModel that represent the desired 
teeth to a new position. The dental care provide may remove teeth to determine spacing of 
1 5 the remaining teeth as a course of treatment for a patient is created. All of the possible 

variations on treatment options may be explored using the eModel until a desired course of 
treatment is determined. 

Fig. 16b illustrates a different view for the eModel after the top front teeth 1601-1602 
have been moved as shown in Fig 16a. A new eModel for an item, such as the dental models, 
20 may be created through the modification of an existing eModel. Once the new model exists, it 
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may be viewed and manipulated in the same manner as any other eModel Thus the various 
possible views of the original eModel may be viewed once a new eModel has been created. 
In addition, an end user may toggle between the two models to illustrate a before and after 
view of the teeth in light of a proposed treatment plan. All of this treatment planning which 
5 has occurred with physical models and paper and pencil calculations may now be performed 
using the end user computing system. 

Figs. 17a-c illustrate combining an eModel of a patient's teeth with an x-ray according 
to yet another example embodiment of the present invention. Even more significant than the 
simple manipulation of eModels, new types of eModels that combine more than one form of 

10 digital image data to create a composite digital representation of patient data. Fig. 17a 
illustrates a combination of a scanned eModel of a patient's teeth 401-402 that has been 
combined with a corresponding x-ray image 1701 for the patient. In this example, a profile of 
the entire scull is viewed in the x-ray image 1701. The two digital modules, for the teeth 401- 
402 and for the x-ray 1701, both typically possess common reference points from the tips of 

1 5 various teeth and similar structures. When these common points are identified in both 
models, the processing system can register and scale the two models to permit the 
combination of these two different models into a single module. 

Like above, once a new eModel is created, the new eModel may itself be manipulated. 
Fig. 17b illustrates the movement of a patient's lower jaw and teeth about the lower jaw 
20 pivot point 1702. As this movement occurs, the upper portion of the teeth eModel 402 and 
the lower portion of the teeth eModel 401 may be observed. As such, additional 
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considerations may be viewed while a treatment plan is determined for a patient. 

Fig. 17c further illustrates the possible options as the composite eModel 1710 has 
been rotated to display more of a frontal view of the teeth eModels 401-402 in combination 
with the x-Ray. One skilled in the art will recognize that numerous variations on the types of 
5 x-rays and other digital image data, including but not limited to digital photographs and textual 
annotation, that may be combined with scanned eModels to obtain an image based eModel- 
processing system without deviating from the spirit and scope of the present invention as 
recited within the attached claims. 

Fig. 18 illustrates processing modules used to implement an eModel data server 

1 0 according to an embodiment of the present invention. As discussed in Fig. 1 3, the eModel 

server 103 includes a communications server 1201 that has a client interface module 1301, an 

eModel generation interface module 1302, and a command and control-processing module 

1301. In addition, the communications server 1201 includes a data communications interface 

module 1802 to perform processing functions needed to send and receive data 

1 5 communications to and from other processing modules over the local area network 1 83 1 . The 

command and control processing module 1301 receives requests for data operations and 

interacts with either a database I/O processing module 1 803 or an eModel file I/O processing 

module 1804 to complete the processing. The database I/O processing module 1803 is 

responsible for all database query requests that occur when end users search for eModels of 

20 interest. The database I/O processing module 1803 also is responsible for storing new 

information into the relational database. The eModel file I/O processing module 1804 is 
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responsible for storing eModels into the file storage database and for transferring stored 
eModels to end users. 

The client interface module 1301 consists of an end user authentication module 1811, 
a database query module 1812, and a file transfer module 1813. The end user authentication 
5 module 1811 processes all end user attempts to log into the server to search for and access 
eModels. The database query module 1812 processes all incoming search requests to 
generate and process relational database queries to locate matching eModels based upon file 
header info data. The file transfer module 1813 processes all eModel transfer requests to 
send eModels to end-users. 

10 The eModel generation interface module 1302 processes all commands to store new 

eModels generated in the eModel generation system into the data server. The eModel 
generation interface module 1302 includes a header extraction module 1821, a database storage 
module 1822, and a file server storage module 1823 to complete its functions. The header 
extraction module 1 821 extracts the file header info data from incoming eModels and formats 

1 5 them for insertion into the relational database. The database storage module 1 822 stores the 
formatted header data into the relational database as needed to permit easy and efficient 
searches. The file server storage module 1 823 performs the operations needed to store the 
eModels into the file storage server. 

Fig. 19 illustrates an operational flow for the processing performed within an eModel 
20 data server according to yet another example embodiment of the present invention. The 
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process starts 1901 and the data server receives an eModel in module 1911 after it has been 
generated in some manner. One a new eModel has been received, module 1912 extracts a file 
header info data from the eModel file. This module 1912 formats this information and 
necessary and stores it into a searchable relational database for use in locating the 
corresponding eModel at a later date. 

Next, the server stores the eModel file into a file storage server in module 1913 in 
order to allow the eModel to be retrieved by end users. The end users locate the eModels by 
submitting a query to the relational database to perform a search on the file header info data. 
The server receives the query request in module 1914 which causes the module 1914 to query 
the relational database and return the query results to the end user. The end user next sends a 
request for additional queries if necessary to identify any eModels of interest. 

Once the end user has identifies a desired eModel, the end user sends a request for an 
eModel to the data server which is received in module 1915. Test module 1916 determines if 
the end user is permitted access to the requested eModel. If access is permitted, the eModel 
is transferred to the end user by module 1917 and the processing ends. If test module 1916 
determines that access to the eModel is not permitted, the error message is returned to the 
end user by module 1919 and the processing also ends. One skilled in the art will recognize 
that alternate user authentication and access authorization mechanisms may be used to limit 
access to end users when database queries are made as well as when eModels are accessed 
without deviating from the spirit and scope of the present invention as recited within the 
attached claims. 
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Fig. 20 illustrates processing modules used to implement an end user client computer 
according to yet another example embodiment of the present invention. The end user client 
computer includes a set of processing modules to provide a window-based user environment 
to interact with eModels. The client computer 2001 includes a graphical user interface (GUI) 
module 2012, a command processing and control module 201 1, an eModel Item Manipulate 
module 2010, an eModel storage module 2015, an eModel retrieval module 2013, and a data 
communications interface module 2014. The client computer 2001 may also include local 
mass storage 2016 to maintain eModels locally as well as on the data server 103. 

The end user interacts with the client computer 2001 through the GUI interface 
module 2012. The end user enters commands using a pointing device such as a mouse or 
trackball and using keyboard commands. These commands are processed by the command 
processing and control module 201 1 which send processing requests to the other modules to 
complete the requested command. 

Commands to view an eModel is processed by the eModel retrieval module 2013. 

The eModel retrieval module 2013 obtains a list of the locally available eModels from the 

eModel storage module 2015 as well as communicates with the remote data server 103 using 

the data communications interface module 2014. The end user is presented with a list of 

available eModels from which an eModel is selected and retrieved. The eModel is retrieved 

from local storage 2016 if available. If not, the eModel may be transferred from the remote 

storage. If desired, the retrieved eModel may be stored locally when retrieved from the 

remote server to eliminate the need to down load the eModel in the future. Of course, the 
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eModels may also be stored only upon the remote data server 103 and retrieved when 
needed. 

Once an eModel has been retrieved from data storage, the eModel is processed within 
the eModel Item Manipulate module 2010. This module displays the eModel to the end 
5 user. The eModel Item Manipulate module 20 1 0 includes an item display module 202 1 , an 
item set-up module 2022, and an x-Ray processing module 2023. The item display module 
2021 displays the eModel graphically to the end user as well as performs the image display 
related manipulation operations such as zoom, pan, scroll, and similar visual operations. The 
item set-up module 2022 allows end users to obtain measurements of the eModel and modify 

10 the eModel to create new eModels that may be saved locally using the eModel retrieval 
module 2013. The x-Ray processing module 2023 performs the operations necessary to 
manipulate x-rays as well as combine them with other eModels to create and store composite 
eModels. One skilled in the art will recognize that additional manipulation modules may also 
be used to process commands associated with various composite eModels created using other 

15 supported digital image based eModels without deviating from the spirit and scope of the 
present invention as recited within the attached claims. 

Fig. 21 illustrates an operational flow for the processing performed within an end user 

client computer according to yet another example embodiment of the present invention. The 

end user process starts 2101 and the end user logs into the client computer in module 2110. 

20 This logging in allows the client system to limit access to eModels if needed when the 

eModels represent confidential data, such as patient data, to only users who are trusted to 
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use the data appropriately. 

Once logged in, an end user is presented with a list of locally available eModels that 
were obtained in module 2111. Test module 1212 determines if a desired eModel is available 
locally. If test module 1212 determines that the desired eModel is not available, the client 
5 computer logs into a remote data server in module 21 13 to locate the desired eModel. A 

database query used to locate the desired eModel is sent to the remote server in module 2114 
before receiving a list of remotely available eModels. The end user selects the desired eModel 
and sends a request for the remotely available eModel to be transmitted to the client 
computer in module 2115. The client computer receives the eModel from the remote server 
10 103, stores it locally, and displays it to the user for manipulation in module 2118. 

If test module 21 12 determines the desired eModel is locally available, the eModel is 
retrieved and displayed to the user in module 2117 before a user manipulates it in module 
2118. The end user interactively manipulates the eModel as needed in module 21 1 8 to 
perform the analysis and planning functions that the eModel is useful is assisting. Test 
1 5 module 2119 determines if a new eModel has been created that an end user wishes to save 
locally. If a new eModel is to be saved, module 2120 will save the newly created eModel 
locally before the processing ends 2102, If module 2119 determines that a new eModel is not 
to be saved, the processing ends immediately 2102. 

Figure 2 illustrates an example of a suitable operating environment 121 in which the 
20 invention may be implemented. The operating environment is only one example of a suitable 
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operating environment 121 and is not intended to suggest any limitation as to the scope of 
use or functionality of the invention. Other well known computing systems, environments, 
and/or configurations that may be suitable for use with the invention include, but are not 
limited to, personal computers, server computers, held-held or laptop devices, multiprocessor 
systems, microprocessor-based systems, programmable consumer electronics, network PCs, 
minicomputers, mainframe computers, distributed computing environments that include any 
of the above systems or devices, and the like. 

The invention may also be described in the general context of computer-executable 
instructions, such as program modules, executed by one or more computers or other devices. 
Generally, program modules include routines, programs, objects, components, data 
structures, etc. that perform particular tasks or implement particular abstract data types. 
Typically the functionality of the program modules may be combined or distributed in 
desired in various embodiments. 

A network server 121 typically includes at least some form of computer readable 

media. Computer readable media can be any available media that can be accessed by the 

network server 110. By way of example, and not limitation, computer readable media may 

comprise computer storage media and communication media. Computer storage media 

includes volatile and nonvolatile, removable and non-removable media implemented in any 

method or technology for storage of information such as computer readable instructions, data 

structures, program modules or other data. Computer storage media includes, but is not 

limited to, RAM, ROM, EEPROM 3 flash memory or other memory technology, BC-ROM, 
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digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, 
magnetic disk storage or other magnetic storage devices, or any other medium which can be 
used to store the desired information and which can be accessed by the network server 110. 

Communication media typically embodies computer readable instructions, data 
5 structures, program modules or other data in a modulated data signal such as a carrier wave or 
other transport mechanism and includes any information delivery media. The term 
"modulated data signal" means a signal that has one or more of its characteristics set or 
changed in such a manner as to encode information in the signal. By way of example, and not 
limitation, communication media includes wired media such as a wired network or direct- 
10 wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. 
Combinations of any of the above should also be included within the scope of computer 
readable media. 

While the above embodiments of the present invention describe a network based 
processing system providing processing services to remote clients, one skilled in the art will 
1 5 recognize that the various distributed computing architectures may be used to implement the 
present invention as recited within the attached claims. It is to be understood that other 
embodiments may be utilized and operational changes may be made without departing from 
the scope of the present invention. 

The foregoing description of the exemplary embodiments of the invention has been 
20 presented for the purposes of illustration and description. They are not intended to be 
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exhaustive or to limit the invention to the precise forms disclosed. Many modifications and 
variations are possible in light of the above teaching. It is intended that the scope of the 
invention be limited not with this detailed description, but rather by the claims appended 
hereto. Thus the present invention is presently embodied as a method, apparatus, computer 
storage medium or propagated signal containing a computer program for providing a method, 
apparatus, and article of manufacture for providing a distributed computing system for the 
creation and distribution of electronic models of objects. 
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